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Cp:Worker Invoivemeht Instrument 
Abstract 

This paper describes the development and psychometric vaSdatlon of the Co^iker 
Invoh/ement Instrument. StucSes of reliability included Inter-rater and test*refect reliability. 
Validity stucfiestnduded content and validity. Al! reliability con^eiations met or exceeded 
.80, and the >^Iidrty of the Instniment was also supported. Potential appBcations of the 
Instrument were also discussed. 
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The Co-worker involvement Instrument 
There has been great progress made in the integration of persons with handteaps over the 
past 15 yeans* In 1973* Section 504 of the Rehabilitation Act prohbitad any state or local 
government as well as any pnvate organization receiving federal funds from discriminating 
against an othenvise qualified person solely on the basis of the person's handicap. Education for 
all chitdren with handicaps was federally mandated in 1975 (PL 94-142), as was the provision 
of transition services eight years later (Section 626 of the 1 983 Amendments to PL 94-1 42). 
This combination of antidiscrimination legislation (Section 504) and federal grant programs 
(PL 94-142 and amendments) resulted in the anticipation of bicreasing opportunities for the 
high school graduate witii handicaps. However, it seems tiiat in spite of tiiese legislative 
mandateSt dramatic increases in opportunities for Integrated employment have not occurred and 
unemptoyment rates of 50*75% pen/ade (U.S. Commission on Civil Rights, 1 983). 
Apparentiy, changing expectations alone cannot ensure desired ernplcyment outcomes as it 
appears there may be a number of other factors that infiuence empioyment status. 

Wehman (1981) identified parent, supervisor, and co-worker involvement as "other" 
factors impacting tiie employment of persons with handicaps. Traditionally, vocational 
educators/trainers have taken an individual level perspective of \he employment context 
(Rappaport, 1977), a posture which places tiie responsibility for change on the targe! 
employed. The consideration of tiiese outside Influences represents a change from tiie total 
emphasis on the training needs of a specific student typified by spedal education's Individualized 
Education Plan (lEP), to a broadened outiook which considers interactions among individuals, 
groups and systems In the employment context. 

Rusch and Mindi (1988) reviewed empirical studies conducted in non-sheitered 
employment settings and found five functions which co-workers served In the instruction of 
target empk>yees witfi mental retardation. These roles can be referred to as prescribed rotes as 
they may be required of a co-worker. They were; a) validating in$truc!lonai strategies (Schutz, 
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Co-worker Involvenient Instrument 4 
Ru8ch, and limnson, 1980; Rusch and Menci)etti» 1981), b) coHeoting subiectfve evaluations 
(Crouch, Rusch, and Kartan, 1984; Rusch, Weithers. Menchatti» and Schutz, 1980; Schutz, 
Jostes, Rusch, and Lamson, 1980; White and Rusch, 1983;}, c) Implementing training ' 
procedurGS (Crouch, Rusch, and Karlan, 1984; Kodiany, Simpson, Hill, and Wehman, 1982; 
Rusch and Menchetti, 1981; Rusch, Weithers, Menchetti, and Schutz, 1980; Stanford and 
We^.tnan, 1982), d) collecting social comparison infomiation (Crouch, Rusch, and Karlan, 
1984; Rusch, Weithers, Menchetti, and Schutz, 1980; Rusch, Morgan, Martin, Riva. and 
Agran, 1985), and e) maintaining behavior in the context of actual employment (Rusch and 
Menchetti, 1981; Rusdi, Weithers, Menchetti, and Schutz, 1980; Rusch, Morgan, Martin, 
Riva, and Agran, 1985; Kochany, Simpson, Hiii, and Wehman, 1982; Stanford and Wehman, 
1982). In a study of co-worker support to empfoyees with haridfoaps, Mbich (1987) also 
Mentified 0 associating, g) befriending, and h) advocating as co*worker support roles. 
Because these ro!e3 demand initiation from.the co-worker to the target empfoyee, they are 
referred to as voiltfonal roles. Rnally, Rusch, Minch, and Hughes (in press), via Interviews 
with supervisors alluded to another potential volitional role, i) {nformatton giving, so that In 
all, there are nine general roles identified in the »1terature. 

Therefore, Instructfonal roles make up five of the nine roles Uentified. As mentioned 
above, these can also be referred to as prescribed r^les and a)!!apsed kite two general 
categories; training and evaluating. Training Includes such roles as validating instructional 
strategies, Iniplementlng training procedures, and maintaining b^havfor In the context of actual 
employment Evaluating includes collecting subjective evaluations and coliecting social 
comparteon Informatfon. Obvtou8ly» although these roles were assigned to categories, there is 
much overlap. For example, training must be based upon evaluation, and evaluatton often 
results in training. 

The remaining four of the nine rotes were Identifiod as co-worker support rotes, As 
stated, these can also be refenred to as volitfonal roles and include associating, befriending, 
advocating, and Information giving. By volition, the implfoation Is made that unless co-workers 
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desira this type of involvement, H wilt not occur. For example, although a ca-;vorker can be 
required to evaluate another employee each co*worker himself makes the perrx)nal choice of 
whether or not to befriend, advocate for, or even associate with a target employee. This presents 
the potential problem of trying to motivate co*workens to become Invoived in roles which foster 
independence in employees with handicaps. Such problems and motivational means have been 
mentioned in the literature (White and Rusch, 1983). Although such relationships can be 
facintated, they can hardly be mandated. Yet, it is suspected that they are crucial to successful 
employment. 

The work associated with the kientificatlon of these nine roles is important because it 
indtoates that co*workers are indeed involved with ernployees ivith handicaps in employment 
settings in a variety of ways (Minch, 1 987; Rusch, Hughes, Johnson, and Minch, 1 988; 
McNair, 1 989). This finding Is fundamental to the future devefopment of a theory of the impact 
of co-workers on the employment status of persons with handicaps. 

Although this preliminary research has demonstrated that co-workers are involved with 
employees with handicaps in integrated employment settings there Is still a great deal of work to 
be done. Co-worker involvement could prove to be a potentially mitigating variable in such 
activities as vocational training and job match. In addition it may contribute to job retentton In 
supported empfoyees. An important first step In the study of the impact of co-worker 
involvement on the aforementtoned variables is the devek>pment of a reliable and valid 
instmment to measure co-worker Invoh/ement with supported emptoyees. It Is the goal of this 
study to describe the devek>pment and psychometirc validatton of such an instrument. 

the Co-worker Involvement Instrument fThft Instmment^^ 
The Co-worker Involvement Instrument (Rusch, Hughes, & McNair, 1988) contains ten 
items. The items were drawn from the literature identified above, and from the experience of the 
authors of the instrument. Items pertain to (a) physical integratk>n, (b) sodal integration, (c) 
vocatk)nal fntegratton, (d) training, (e) associating frequency, (0 associating nature, (g) 
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befrlendlno, (h) advocating. CO evaluatlfig. and (D information giving. The items are defined In 
Tablel. 

Insert Table 1 about here 



Sflnriiny Procedures 

The Instrument Is designed to be scored by an employment specialist or a supervisor. Each 
Hem may bo scored by selecting one of three choices { 2,1 . or 0) resulting in a maximum;score of 
20. Scoring procedures are simflar for each Item and in every case Hems are scored onjthe basisof 
information gathertad from emptoyment site experience, relevant documents, observatioiis and/or 
verbal reports. Verbal reports can come from the target employee himself/herself, co-wiirkers, 
supervisors, and/or an employment specialist. 



insert Figure 1 about hera 



Co-vrorkers are identified as potentiai sources of information according to the Co^yyorker 
Identlficatton and Interview Procedure outlined In Figure 1 . Verbal report infonnaflon Is aiiiected 
via a co-woiker Intenrfew schedule, which allows the scorer to conecl alj the informatlcn meded to 
SCOT© the Co-worker Involvement Instrument In a single intenrfew. to be considered validi the 
co-workert or target employee's verbal report must be oorrpborated by the target erhpteyert (in the 
case of a oo-workar reportK another co-worker, an emptoyment specialist or a supervisor. 
IndlvWuals such at pwents, group home or independent IMrig staff can also be used for valiciatlon of 
Item 7, (Befriending). Once informatton is validated, tha Instrument Is then scored using that 
partteular information. If infomiatton Is not corroborated by any of the above mentfoned personi^, 
the scorer must disregard that information and begin again with another co-worker. If three 
co-workers have been approached and none of them knows or interacts with the tatget employee or 
knows of someone who does, then the process Is stopped. The Instrument Is then scored based upon 
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Co-worker Invblvtment instrument 7 
.r>h>»ivflHQfnil nnri wilm/ant riftrtimAnt data. It te ImPbrtant to notft that flhhniinh these soecfflc 
Pfocedures are outltned for Id entlfteatton of co-workers and scoring of soedfte Items, tt Is assumed 
that employment spaclaljgts qnd supervisors will have a high degree of familiarity y/itfi the sitfe. 
the target em ployee, aruj co^workars. As a result, thev should be able to score the insfrument using 
the Individual Hem scoring procedures alone. The instructions for scorers (including the 
Co-worker ldent!fk:atk>n and Interview Procedures) are therefore provide<i largely to guide a 
scorer only In the event that specific Information Is not known to him or her. 

Specific scoring procedures for each item are outlined In the Co-wori<er Involvement Manual. 
By way of example. Item 1, Physical Integration, states that ''Target employee wori<s, takes breaks, 
and eats meals In the same areas at the same time as co-wori^ers.*" The item can then be scored In 
one of three ways. A soore of two conresponds to the statement Target empfoyee works in the same 
work areas at the same time as co-wori<ers a portlc f the day and takesS breaks and eats meals In 
the same areas (le., in the same room, within 600 square feet) as co-wori<ers,*' A score of one 
Indicates that the Target empfoyee does not w^.^ In the same areas at the same time as co-wcrkers 
but takes breaks and/or eats meats In the same areas as co-woricers.*" Rnally, a score of zero 
conresponds to the statement Tafget employee does not woric, take breaks, or eat meats In the same 
areas or at the same time as co-wori^ers.** The Infonnatlon necessary to score this item Is gathered 
via observations during lunch, work breaks, and during actual woric on-the-job. Relevant 
documents can also be considered such as wori< or observational records. 

• A second example Is Item 5, Associating (frequency), whteh states, *'Co-wori(er socially 
Interacts with the target empfoyee at the wori< place.** This Hern is scored on the basis of whether 
the Xo-wori<er socially Interacts with the target empfoyee at the wortc place on a regular basis, 
typfoaiiy on a daily basis,*" (scored two), *'Co-wort(er interacts with the target empfoyee at the 
woricplace on an irregular basis, usually only a few times per week,*" (scored one), or *'Co-wori<er 
Interacts with the target empfoyee at the woricplace on an irregular basis, usually only once or twice 
a month. Interactfons are not Intentfonal,** (scored zero). The Informatfon necessary to score this 
item is also gathered from relevant documents, observational records, and In this case, veriDal 
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Co-worker Involvement Instrument 8 
reports by co-workerSi the target employeei the employment spedallst or Job supen^r. 
HoweveTi verbal reports by co-woikers or the target employee must be corroborated by one of the 
foliowirHJ persons; supervisor, employment specialist, target emi>iqyee (In the case of o co-Worker 
report) or another co-worker. Corroboration simply Involves getting agreement from the 
conoborator that associating (In this case) did occur with om of the persons mentioned. 

Methods 

Forty-nine supported emptoyment projects across the State of Illinois were contacted: 
requesting their partidpatton In the Co-worker involvement Study. Of the 49, 17 projects 
expressed interest In the study. However, five of these projects were not included because they 
either dkJ not meet the minimum aiteria of having a target en^ptoyee In a supported emptoyment 
program for at least three consecutive months or they later deckled not to be Involved. Twelve 
projects were then contacted and a visit arranged. At that time, target emptoyees were selected by 
the k>cal project personnel (supen/isors or empk>yment specialists) for Involvemerit In the study. 
In some cases, the Indh/kkiats selected were the oniy ones working in a particular agency's supported 
empk>yrri8nt program. However, In Isirger agencies a partteular emptoyment spedallst might be. 
wortdnig witfi a supported emptoyee unknown to other emptoymentspeclallsts working through the 
same agency* This was most often the case resulting in target emptoyees being selected on the basis 
of the two raters having ongoing contact with the target emptoyee In the^mpbyment setting. 

Reliabillty was.measured In two. ways. Inter-rater reliability and test-retest reliability. The 
instrument Is designed to be scored by empbyment spedalists and/or supervisors. 1t Is therefore 
crticlal that co-worker Involvement be scored by each rater In the same manner. Further, the 
Amartean Psychok)gk:al.Associatk>n (1985) Indicate that the degree of covicordance across 
independent ratings sho^ikJ be reported as an indk:atIon of reliability. A test-retest reliability study 
was also Indteated. By conrelating scores given at two separate times by the same rater, the 
Instnjmenf s consistency of measurement over time was assessed. 
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in&art Figure Z^bouX here 

The reliability studies were organized as displayed In Figure 2. At time 1 » rater 1 and rater^ 
s(X)red the instrument Independently In reference to a single target employee. The comparison of 
these ratings comprised the Inter-rater reliability study. 

A test-retest study was also undertal(en. The comparison of rater one's score at time 1 with 
ills/her score at time 2 comprised the test-retest reliability study. 

Inter«rater RQHabillty. The raters in the Inter-rater reliability studies were either 
Gmpioymant specialists or supervisors woridng with supported enniptoyment programs across the 
state of IMnols. They had to meet the requirement of having had Involvement in the job site lor a 
minimum of three consecutive nnonths prior to scoring the instrument. The target employees 
woriced at a variety of Jobs across the four placement types. 

The types of placements in which target employee's were woridng were individual placements, 
dustered enclaves, dispersed enclaves or .mobile woric crews. Within the placements, various job 
types were represented. They were light Industrial^ laundry, warehouse, maintenance, retail, food 
service, clerical, and health care. ' 

As mentioned above ^he Instrument was designed to be scored by employmdnt specialists, or 
supervisors familiar with a job site for a mlnln ,um of three months. Prtor to an agreed upon date on. 
which the instrurhent was to be scored, the Investigators sent each rater a copy of the Instrument 
with the Instructions to readi^e manual and to be prepared to score the instalment on a particular 
target employee at a specified time. At that time (time 1), two raters independently scored the 
instrurhent in reference to the same target employee in the presence of the investigator. 

Two Pearson product-numient correlations were used to compute the Inter-rater reliability 
coefficient The first figure relates to comparisons between raters (organized into rater pairs) 
scoring the Instrument on the total number of employees w h mental retardation. However, because 
the two raters comprising a rater pair coi 'd score the instrument on nfK^re than one target employee. 



10 



Co-wortir InvbJvement Insiniment 1 0 

«««l.«»pot«M:Wbl»*bmov.*r.p«s«l«l«.rp.i™.F«.thl.r«Wi.^ 

«,,rp.lr.Th,c«n^o.*«. s«ondPea«np»xkK.-^^^^ 
,.-,u,»dhth.,«»ndW«^«llabllWco,..la.1on.AaH«lonof.75v«sse.a,t^ 

minlmuin acceptable corrolalton. 

T„„....~.p.«.hili^,. |„tt,,»st-«t.5tre«abllit,stud,,ll,e«lminl8trallonp«»«lu«s 

fo, « .cortng of «,e Instrnment («m. 1) .h. »m. » those I. the .nt«.ra..r 
,eW.tu*.Th.malndlflereno.lnt»s.udy,wastha.6.,mpto»™ent.j»c^^^^ 
^.^d.slgna«da.ra»r1.«ored.helns.n,men,aseoondflme(.ln,e2)us.-««..same 

,a^,,mpto,.e™f.rentAfter.t,.«sooHn,of.he.ns.™«>t.lh.«ud.ml^^^ 
«p,of«,.!™tn,mentw(l..«h«t»r1^thth.u«<e™tan<«09««.tt..y«uHb.contac.«l. 

^.K, .0 resoo™ It The e,.plo,n,en. or .upe.,.so, wa. *.n oon»««l »«. 

re«o™d. Co.n^«l InslmmenB «>.e then reamed h «l.-add«»ed .tamped 
e^elopes. Th. .^stadmlnbt^tton a«.seco„d«lm,„.st«tton w,r.«h,d.led«d^^ 
peKodofapp^xImate^l weel. The compamono. rater rssco« a, tim. .with rater a. 

Ihne 2 oompilsed the tcst-retest reliability study. 

A Pea,«.r. praduct-moment correlation coefTclent was computed on overall scores to 
det.,m»,.t.s.-r.t.stren«ty. AcrterMof .75 wasonceaga^setasthe minimum acceptable 

correlation. 

Valldliv , 

Th. O«o*er lnv.Mn.nt Instmment attempts to me«.u™ the constmC of -co-woAer 
^Wn,.nrwlth.mploye«v.«,han<M«». emplo,men,set«n,.. ConstnK^vaMtyWas 
^„«,at«ivlaas,udyofcontenfv.««y.Thegoalofthecon,entva«V».«Vw»>oaen«fy 

»,.oretlca»y meanln,ful lactots contlbutlng to an unde^undlng of the construct -coworker 
Involvement* 

Astudy of face valk««ywas^unde,taken.odetem.lne whether potential rasrs of the 
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« 

instrumant agreed that the insmiment measured oo-worker involvemerit as they perceived it. This 
study be presented first 

Fflg# VawAty. In order to determine face vatidtyt the author provided the Instrument and ' 
manual to potential instrument scorers and asl^ed questions about whether the instrument measured 
oo-worker involvement as they understood it. 

Across the state of Illinois there are 49 supportdd empbyment pfojects. The subjects for this 
study were the directors of these prelects. Tt directors were sent the Instrument with manual 
and an evaluation fom. The evaluation hms listed each Item followed b/ the statements^ "^Yes, it is 
appropriate to Include Item X" or "No, it is not appropriate to include Item X " There was also the 
opportunity to respond to the statement, "Please indicate whether you feel the overall Instrument is 
appropriate^ measuring ^-woricer involvemenr by ched^Ing "Yes, it is appropriate'' or "No, it 
is not appropriate." After each question, evaluators* comments were invited. Upon completion, 
these evaluations were returned to the investigator In self-address^ envelopes. 

Evaluation data were compiled for each item and the overall instrument to determine the 
agreement of the judges* ratings* 

Cons ent >/alidity. The administration procedures described Jn the tdst-reteslreliablllty study 
were also used In the validity study. The two sets of completed instruments (raterl at time 1 and 
rater 2 at time 2) were each submitted to analyses that included, a) a factor analysis with the 
selection of terminal factors via oblique rotation for rater 1 8(x>res at time 1 and rater 1 scores at 
time 2 and b) the comparison of factors identified via oblique rotation at time 1 with those at time 2 
to determine whether there was a devetopmenial trend iri scores. Oblique rotation was selected 
because it wm suspected thait thererwere underlying retattonshif^ between varieties. A criterion of 
.CO was set for the magnitude of the rotated factor ioadingst 

Results and Pfscussion 

RflMllty 

Inter-rater Reliabi Hlv Study. There were 68 target employees for whom the Instmment was 
scored (see Teble 2)» Involvement was scored by 30 different raters, the majority of whom were 
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emptoyment specialists (82%). Because most raters were employment upedalfsts, their 
famiSarfty with and Invoivemeni at the work site reflects the majority of their experience with the 
work she. That !s, emptoyment specialists would be expected to spend only the amount of time ^ 
required to support the target emptoyee at the work site, whereas supen^isors wouU be employees 
of the business where the target empk>yee was working. Most raters therefore were either ne\Arfy 
acquainted with the work site (3-5 nK)nths, 39%) or had been familiar with the work site fcr more 
than 1 year (40%). Additionatiyt most raters had daily Involvement at the work site (66%). 



Insert Table 2 about here 



Individual and employment demcgraphtes are displayed In Table 3. Of the 68 employees who 
comprised the Inter-rater reliability sample, 52 percent were females and 48 percent mates. 
Levels of mental retardation were estimated by iQ scores and compared wHh the American 
Assoclatton on Mental Defk^Iency (AAMD) dassifteatton schema (Grossman. 1983). Based upon this 
criteria, 1 7 percent of wori^rs had IQ scores In the borderiine range, 42 percent were In tfie mHd 
range, 25 percent were In the moderate range, 16 percent were In the severe range of mental 
retardatton and none were In the profound range. 



Insert Table 3 about here 



Target employees were largely woridng in enclave placements (dustered endaves 43%, 
dispersed endaves 37%) with a smaller percentage In individual placements (20%). There were 
no wori<ers In this study woridng In moblte wori( crews. They most frequently labored In food 
service (34%), light Industry (31%) or maintenance positions (18%). On the average, they had 
been woridng on th« Job 9 (median) to 14 {mean) months. The median score Is more representative 
of the actual time on Uie Job aaoss the target employees, as one target employee had been employed 
for 99 nrK)ntfi3 whk^ elevated the tai^et employee time on the job mean. 
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Co«worker Invoivement Instrument 1 3 

The Pearsq[i product-moment correlations for the lnter*rater relj^Jity studies were r«.82 
far the whole group (n«68) and r».80 for the unique pairs(n«1 8). These scores surpassed the 
predetennkied crfteiion for significance of r- J5, therefore supporting the reliability of the \ 
Instrument across raters. 

Test>retefit,RQ»abiHtv Study . In the test-retest reliability study* there were 54 target 
empfoyees on whom co-worker involvement was scored (see Table 1}. The Insttuments were scored 
by , / different raters. 89 percent of whom were employment specialists. The mean time period 
between the first (time 1 ) and second (time 2} administration of the kistrument was nine days. 
Raters most frequently were famHiar wHh the work site for 3 to 5 months (35%) or for mom than 
1 year (33%). They most often had daily (59%) involvement at the worksite although many were 
present 2 to 4 times per week (24%). As mentioned above, the ovenivhatming majority or scorers 
being employment ^)eclalist8, lends credability to employment specialist knowledge of the work site 
beirtg consistent with rater knowledge of . ^e work site. 

Most of the target empk^ees were males (53%) in this study, although not signrfk^tly more 
(females 47%) (see Table 2). As in tiie inter-rater study, the level of mental retardatfon of the 
target empfoyees was most often miki (45%), folfowed by moderate (27%) and borderline (20%). 
These employees most often worked In clustered (41%) or cfepersedf (35%) enclaves, followed by 
incfividua! (18%) and mobile work crew (6%) placements. Empfoyees most frequently worked In 
either food sen/ice (40%) or maintenance Jobs (24%). The mean time on the job for the target 
empfoyees was 1 1 months with a range of 35 months. 

The Pearson product-mpment correlation for the test-retest reliability study was r«.S8. 
This conelatfon surpassed the criterfon of r«.75 and therefore supported the reliability of the 
instrument over time. 
Validity 

py^VaMly . In order to determine face vaHdlty, the author provkled a test packet to 
potential instrnment scorers and asked questfons about whether the Instnjment measured co-worker 
involvement as the potential raters understood it. A total of 22 instalment evaluations were 
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compieted. AR but tiiree of the items were considerdd "appropriate to indude" by 90%sor more of 
the raters. Three Hems (itom 6: Associating NaturSi 86%; item 7: BefrierKSng, 77%; Item 9: 
Evalu^ng; 86%) were considered appropriate by tess than 90% of the raters. Most importantly/ 
90% of the raters indicated that overafl, ''the Co-woricer involvement Instrument Is appropriate for 
measuring co-woricer inydvement." 

Content Validrty, Two ^K2tor analyses were a>mpleted for the validity Study. The first analysis 
used ratings completed by rateri at time 1 and ttie second foctor analysis used ratings completed.by 
rater 1 at time 2. The following is a description of factors resulting from eadi of these analyses. 



insert Table 4 about here 



The first analysis (rater 1 time 1) resulted in three factors (see Tdbie 4). Factor 1 
contained 7 items inciuding^ physical integration (item 1), social integration (item 2). vocational 
integration (Item 3), assodating frequency (Item 5}, associating nature (Item G), advocating (Item 
8) and information giving (Item 10). This factor accounted for 80 percent of tfie variance, 
indicating that co-woricer involvement as measured is largely a 1 factor construct This factor 
comprises the variables frnpacting tiie opportunity for involvement (integration items) and the 
voliifonal roles (except for be^ndkig whidi will be addressed later). Trabiing and evaluating 
loaded on this factor but tiiey also toaded hIghV on a second factor which will be discussed separately. 
This combination of Integration and volitional ro'/es interesting. Integration would most probably 

have tiie greatest impact on al of tiie volitional roles wiUi tiie exception of befriending, due to the 

/ 

way it is defined If target employees and co-woricers were not integrated^ there would be little 
opportunity to associate, advocate or provide Infonnation in spite of a desiro on tiie part of 
co*wori(ers to do so. This would be true for each of the volitional roles. However, in the case of 
befriending, by definition, occunrence was based upon interactions outside of the wori(place. So, 
sdthough one would assume tiiat initial contacts would be made during tiie wortc day, befriending as 
defined may not necessarih/ relate to integration. 
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Factor 2 was comprised of the prescribed roles and accounted for 12 percent of tHe variance. 
These roles were traininjo (Item 4) and evaluating (Item 9). Advocating also toaded/in factor two, 
but not as greatfy as on ^K^tor 1 . Interestingly, the 3 integration variables loaded negatively or ^ 
dose to :^ero on this factor, tiie strangest belna vocational integration (%46) follpwed by physical 
Integraiion and soda! Integration. In ti)e case of vocational integration, this significantly negative 
loading implies that pr^cribed roles are most evkient when vocationai ini^graUon is low and least 
evident when vocatbnal integ^tion high. Intuitively, tiiis mai<es sense. As a person becomes 
more vocationally competent, he or she would receive less training and their evaluation schedule 
would more approximate that experienced by co*wort<ers. 

In regards to social integration, tiie loadings were not as strong. Hoivever, the negative 
relationsh*^ to prescnbed roles may be explained in a manner simHar to that.for vocations^ 
integration. That Is, as prescribed rofes are inaeasingiy evidenced, sodai integration decreases and 
as prescrased roles are less evident, tfiere is increased social integration. Once again, tills seems 
logical. As an empbyee becomes more competent at her or his Job, the amount of training and 
evaluating would approach levels experienced by co*wori(ers, which are most probs^fy low. Also, 
witti increased competence, there would most likely be increased opportunities to interact with 
oo-wori<er8 and still complete ones woric. The reverse would also be true. WiUi decreased 
competence, tiiere would be heightened levels of training and evaluating, and tiiere would be less 
social integration as the woricer struggles to 1<eep up." 

Lastiy, tiiere was no relationship between prescribed roles and pt:ysicai integration. This 
might imply tiiitt trainers or evaiuators of empioy^es with handicaps are not necessarily those with 
whom tiie target employee is physically Integrated. Perhaps tiiey are located in a different area of 
tlie business. If tills is the case, it suggests there might have been a misunderstanding of the 
defir.hion of "oo^woricer" among raters, or may further support the concept of association 
Independent co*wori(er roles which will be discussed later. 

The final factor, Befriending (Item 7), accounted for 8 percent of the variance. This was the 
only factor on which Befriending loaded. Training also loaded on factor 3, but there was 
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oonfoundng as trsdning loaded highly on all threa factors. 

The saoond factor analysis (raterl time 2) also resulted in threeiactors. Factor 1 was 
comprised of.the three Integration items and the two dissociating items. The remarkably, high ' 
toadiftgs of these variables indicates a strong relationship between assodating and integration. This 
finding is as would be expected, and therefore supports the validity of the instrument. This factor 
accounted fb? 74 percent of the variance. 

The second factor included befriending (item 7), advocating (Item 8), evaluating (Item 9) and 
infonnation giving (Item 10). At first glance this factor Is difficv'lt to interprieit. Upon further 
examination, however, it might be referred to as the hoh-!nterek;^e or non-assodath/a coworker 
involvement ^or. If the items not highV loaded on this factor are compared with thosein the other 
two factors, it is observed that in each of the other two factors the associating Hems load 
significantiy. However, in the case of factor 2, there was no reiationshipi between associating and 
the factor. It therefore might be concluded that jthere is at least a component of each of the roles in 
factor 2, whidi does not require assodation between co-worfcers and employers with handicaps in 
the workplace. As was already pointed out, befriending is defined on the basis of interactions outside 
of the worfc(^ace. Regarding advocating, a large percentage of advocating is done oh beha!f of the 
target employee without associations with him or her. Evaluation in the workplace very often only 
involves Interactions if work performance is substandard. This leaves information giving. One 
aspect of the definitton of infbrmatk>n giving in the Instrument is that co«workers will answer 
questtons. However, a pereon who is wiHIng to answer questtons may not be apf^ He or she 

would still be regarded as fulfRling the information giving role without there being any interactions 

/ 

between co-wori(er and tai^et emptoyee. This factor accounted for 1 6 percent of the variance. 

The final factor could be refenred to as the ''associatton dependent' factoi' and accounts for the 
remaining 10 percent of the variance. This factor recleved high toadings on the two associating 
variables (items 5 and 6), advocating (Item 8) and infoVmatlon giving (item 10). If factor two 
relates to aspects of co-wori<er involvement roles not requiring associatton in the woriqplace, 
pertiaps this factor engendom interactive aspects, or co-wori<er roles requiring wori< site 
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affiliation, interestinoiyt ^formation gMno and advocating both tndudtieispects which require 
assodation with the target emptoyee. Howavar, befriending (which doe^ hot bad on this factor) as 
mentioned earter is defined as interactions outside of the workplace. Evaluation which also did not 
load oh this factor may represent the type of evaluation rnost probably experienced by the majority 
of entry level emptoyees» in which communication of evaluative information only occurs when 
perfbonance is substandard, tlowever, the observation that there is no relationship between 
physical Integration and this factor may cause the reader to question this interpretation. 

The factors and their proposed interpretations thus are as shown in Table 4. For the first 
factor analysis, factor 1 wl^ was interpreted as integration/volitional roles, factor 2 as prescribed 
roles and factor 3 as befriending. For the second analysis, factor 1 was interpreted as 
integratioh/assodation, factor 2 as assodation independent ca-wori<er roles and factor 3 ais 
association dependent co*worker roles. 

The next step of the valijdity study was to assess whether there was a deveiopmentai trend in 
the data over the time period between the two factor analyses. Although the interpretation of factors 
differs to some extent between the two analyses, if one were to compare the actual fectors, there was 
a great deal of similarity. The two factor 1*s eac h had 5 variables in common (physical integration, 
social integration, vocational integration, associating frequency and associating nature). Factor 2 
also showed some commonality in that 2 variables loaded highly (advocating and ev^'uating) from 
each study. The only real disagreements occurred In relation to training, befriending and 
infonnation giving. In the case of training, this variable did not load on any of the fadors in the 

second analysis although it did load significantly on all three factors in the first analysis. The 

/ 

befriending item was a separate factor in analysis 1 whereas it Joined several other variables in 
comprising factor 2 in analysis 2. Infomiatlon giving loaded with the other fader 1 volitional roles 
in analysis 1 , but was loaded across two different fadors in analysis 2. Therefore it appears that 
overall, there was more of a stable trend between the two studies than a developmental trend, as 7 
out of 1 0 variables were virtually identical In tenns of their factor loadings. Considered together, 
therefore, these findings support the validity of the Instrument. 
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Conciuatons 

RftttahltHv Qf the CQ>wQ?ker Involvement Instrument 

the reliability study was broken into studies of ihter-rater reiiat)ility and test-retest * 
rellabaity. the Standards for Educational and Psychoiogicat Testing (American Psychological 
Association, 19B5) state that, "Whiue Judgmental process^ enter into the scoring of a test, 
evidence on the degree of agreement between independent scorings should be provided" (p. 22) 
This standard provided the basis for the inclusion of each of the reliability studies. 

In order to confonfn with these and other standards^ studies of inter-rater reliabiiity 
were completed. The first sample was comprised of ail ratings (n«68} made by rater pairs. 
Based upon the ratings of these rater pairs, In which each member of the pab* scored the 
instrument independently in reference to a particular target empfoyee, the total score 
^^!er*raterreliability was estimated to be .82. In the second sample, there were 18 different 
«rater pairs who scorckl the instrument. Based upon these ratings of unique rater pairs, the total 
score inter-rater pliability was estimated to be .80. 

In order to detennine whether there were differences in independent ratings when 
separated by a period of time, a study of test-retest reliability was undertal<en. This Is further 
fulfillment of the "independent scorings" criteria described eariier (American Psychological 
Association, 1985); Based upon the comparison of ratings by the same rater separated by a 
period of time, the total score test-retest reliability was estimated to be .88. 

In each of these cases, the reliability estimate surpassed the predetermined aiterion of 
.75. These analyses support tKc^Co-woricer involvement Instrument as a reliable instalment 
both across raters and over time. 

Methodologically, there were two potential limitations to the reliability studies. The 
design of the inter-rater study was such that thf re vyas the potential for over-representation of 
rater pairs. This imitation was circumvented by calcuaKIng a separate reliability coefficient 
using 18 unique rater pairs. However, this sample size might be considered small by some. 
Although in each analysis, findings did exceed criterion, there remains the possibility that the 
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"supporting* analysis c8d not comprise a large enough sample. 

A second potential methodological weaioiess related to the time period which elapsed 
between the two instrument scorings in the test-retest study. The American Psychological 
Association (1985) indicate that the time interval should represent the nature of the 
assessment device and Its interpretation. It Is difficult to determine What that time period 
should be for tfie Co-v.'orker Involvement Instalment. With further iresearchp it may be found 
that a time period different from the one used in this study is more desirable. 

In s^ .e of these methodological limitations, the Co-wori^r involvement instrument 
appears to be a useful tool. Reliability estimates were good, exceeding .80 in all studies. 
Validity of the Co^workftr Invoh/gment Instrument 

The validity of the Co*wort<er involvement Instrument was supfK)rted by ^he validity 
study. Only one item was considered appropriate to include by less than 80 percent of raters. 
Most importantly, the instrument overall was considered an appropriate measure of co-wori<er 
invoh/ement by 00 percent of the raters. 

AnastasI (1982) states that "Any data throwing light on the nature of the trait under 
consideration and the conditions affecting its development and manifestations are grist for this 
validity mill* (p. 144). The validity study uncovered new aspects of co-wori<er involvement. 
That co-wori<er involvement consists of roles which can be divided into voiitiohal and 
prescribed roles was supported by factor analyses. Volitional roles (associating, advocating, 
information giving) appear lo be related to the degree of Integration of the employee with 
handicaps. On the contrary, pre8cnt>ed roles (training and evaluating) are less Influenced by 
integration. Befriending as a volitionai rote appears to not be influenced by integration, 
although this may be an artifact of the Co^woricer Involvement Instrument's definilkin of 
befriending. 

Apparently, that ca*wori(er involvement may be broi<en into aspects demanding 
a^sodation/affitiation between co*workers and woricers with disabilities, and aspects 
independent of affiliation. The former of these relationships (association being related to 
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k)tcpratio())i seems intuitiveiy correct . in order to associate, persons n^ust be in proximity to 
one another (excludino aiWpciatlon via electronic media). The latter of these observations 
supports statements made eariier regarding, federal integrntion legislatiofi In that integration ' 
atone may not result in po^ worker invoh^ement as there are aspecta of invotverhent whk^ may 
not be directly related to integration. However, in order that this statement rnay not be 
misconstrued, the finding implies that integration alone is not sufftoient. There appear to be 
Important l^ehlnd the scenes* aspects of co-worker involvement which do not directly relate to 
affiliation. Co-worker involvement therefore cannot be totally explained by characteristics of 
indh/Uluals. Interventions must now be directed toward interactions among small group 
members not necessarily involved with the ta^rget employee* These aspects of co-worker 
involvement must be further explored and brought to light In order to dilate th® focus of 
inten/ention. 

Together these obsen/ations support to the instrument's valkitty. Additionally, the jad< of 
a developmental trend across the factor analyses supports the Instrument as measuring a stable 
construct. 

ApoHcattens of the Co-worker Involvement tnstrtiment 

* The Co-worker Involvement instrument in its cunent fomi has several useful 
applications. Rrst, It is a useful research tool for the study of smaH group interactions in the 
workplace. This is evidenced by other studies reported by McNalr (McNair, 1989a; McNair, 
1989b). Secondly, the Instrument might be used in Job sun;ey and analysis procedures, if an 
employee with handteaps is already employed by a particular agency or business, the Instrument 
might be scored in reference to that employee before future individuals are placed In that same 
emptoymeht setting. This information might also therefore be used in job match activities. 
ShouM the client be the first to be placed in that particular setting, co-worker invotvemerit 
among non-handicapped workers might be tested with conclusions being drawn from that 
Infomiation. It is important to note, however, that to date Co-worker Involvement instnjment 
studies of nonhandicapped workers have not been reported so the relationship between 
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^teractibns amohg non-hand(capped woricerii and t)etweeri non-han(fica(9)ed workers with 
viOfkmt wHh hmdteape is stil unknown. 

Then there is the posstoltity that the Instrument migH provkle indications of how 
co-worker invotvemeni is influenced by the training of indivkluais with handicaps, it may be 
that target emptoyee competencies are directly related to cotwprker invotvemeht. Therefore if 
the goal of Inten/ention with an employee with handicaps is io giairi support from co«workers, 
the Instumenv might be used as a measure of the effect of 0)at interyention. 

In sum the Co-worker Involvemont tnstrurhent is a psychome^rically tested and useful 
tool for studying interacttons between workers the empioyrneht context. 
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Notes 

^ The contents of this paper v^re developed under federal contract number 300*85*0160 
from Spec^^ Educatbn Programs^ under the Office of Special Education and Rehabiiitative 
Sen/ices (OSERS), Department of Education. Points of view or opinions do not necessarily 
represent OSERS positions or policy. 

^ Requests for copies of the Co-worker Invoh/ftment instmrnent should be sent to Frank R. 
Rusch» Secondary Transitton Interventton Effectiveness Institute, The University of Illinois at 
Urbana-Chariipaign, 1310 South Sixth Street, Champaign, Illinois 61820. 

Requests for copies of the this artk^e shoukl be sent to Jeff McNair, School of Educatton, 
California State University San Bemadlno, 5500 University Parkway, San Bernadino, CA. 
92407-2397. 
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Tablel 

Ih<> CoiflfQrhftr InvQiYOTiOTt Iristrument Items 



Item 1 : Phyftlol intoflrattoiw TMrgt tmpioyM works, UdcM breaks, and sats msals in the 

same areas It the same tln^ 

2rtaigetemiptoyeewartointto sametinrieasookw(>rkefsaportk>ri 
of thedayandtitosbreiiksandMtsmealsinthes^ (Le., in the same room, within 
600 square feet) as co«wockers. 

1 -Taiget employee does not vi^ takes 
breaks and^br eats meals in the same areas as co^woikers. 

0 - Target employee does not work, take breaks, or eat meals ki the same areas or at the same 
time as oo-wprkers. ' ^ - 

Item 2: Social ihtagratimv WhHe comptetino his/her work, the target employee has an 
appropriate number of opportunities to interact with coworki^ without negative effects on Job 
perfonnance. 

2 - There are an appropriate number of opportunities ior the target emp,^ee to interact 
^wifh cowpritem vHthout negative effects on Job perfonnance. 

1 - There are few opportunities for the target emptoyee to interact with cowcricers witnbut 
negative effects on job performance. 

0 • There are no opportunities for the target employee to interact with coworicers without 
negative effects on Job perfonnance. 

Item 3: Vecattonal Intaffrattoir. Target employee perfonns simitar to co-wori(er. 
Co-woricerisnptreeponstileforany portton of the target empli^'sworic. 

2 -Target eihpbyee performs same or oompanMe taskjt as co^ViKMker with same Job title. 

1 - Target empk>yee does not perfonn same or ooiFiparable tasks ai do^woiker.with sarne job 
^titfe, however, co-wori(er Is not responsl)kr for any portfon of the target empk>yee*s woric 

0 • Co-worker responsible for partial completion of target empfoyee*s vwric 

item 4: Italnloa* Co*^ri(er sufiipocts target empk)yee by provUing or>the-job training of 
sodal or vpcattonal skitis which have been kfontified in the IWRP: 

2 - (kKwoiker is designated for and provkfos dh-the*job training of social or vocational 
skiils for tlvcr target employee 

1 • Co-woricer provkJes on-the-job training of sodal or vocational skiBs to a target 
emptoyee gobt ^ the prompting or assistance of others (e.g., from a Job coach or 
supen^sor)« 

0 - Co-wort<ef does nfit provfcie on-the-job training of sodal or vocationai skills to a target 
employee. 

Item 5: Asaodatlmi ffrequencyV Co-wori(er socially kiteracts with tamet employee at the 
woric place. 

2 - Co-wori(er sodalty interacts witB^tatget employee at the woric place on a regular basis, 

tYPicaHy on a daily basis- 

1 - Co-woricer Interacts with the target employee at the woric plaa^ in an irregular basis, 
usuaWy only a few times per week . 

0 - Co-woricer intreacts sociaKy with target employee at the woricplace once ortwicg a 
month* tnteractiohs are not intentional. 
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tiabie 1 (continued) 

Item 6: A— od^Hn^ (naturayiiQ^wofkttr sodalt/ inibi^acts with^tlie target employee In a 
manner ooneidared appropriate vvHhin the context otihs - 

2 - The maloftty of oo-woricers* spcU^^ interactions bj^^i^^ with target empipyee are 

constderad appropriate nvithh the context of the Wpri^^ 

1 * The maipri^ of op*wofkera* aodai interactional intmt^^ target employee are 
not oorvsldered appropriate within the cpntext^vi&s^K^^ 

0 - There are no sodtaJ interactions or aodai ii\terad^c>ri^l^^ appropriate 
within ihe context of the wpricplace between tt^^t^et erri^ ^b^ ^ co-workers. 

Item 7: Bafrlandlnq - Co-woricer befriends target emptoyee by intentior^tiy interecting 
socially witti the target employee outside of the woricplace. 

2 - CkhworiuK and target employee report intentionally interacting socially outside the 
wori(piace within the last two weeks. 

1 - Co*woricer and target empHoyee report intentionaliy interacting ssdally outside the 
woriqplace at least once in the last month. 

p * O>wori(er and taqet employae report not interacting socialiy outside the wori<place. 

item 8: Advocatlnq -Tha co-woricer advocates for the target employee by goilmluog^ 
protacHng, arid gupporting the target empioyee's employment status. 

2 - Co-vmri^er optimizes, protects and supports the target employee's empbyment status. 
This levet of suooort is orpvided bv the oo>worice r whan needed without the ^isslstance or 

1 * Co-wori(er optimizes, protects and. supports the target employee's e^mployment status. 
This level of support is provided t)y the co^woricer whan need^ with assistance and^or 
pfompHng ftom others . 

0 - Co-wori(er does jost advocate (optimize, protect, support) for target employee's 
employment status. , 

Item 9: Evaluating- Co-wortcer, when assigned the supen/isory responsibility of evaluating 
the target en)ployee, appraises target employee's performance according to an operationalized 
standard and provides c^ect, £¥)propriate (written/verbal) feedback to the target emptoyee on a 
scheduled or informal basis. 

2 - Co-woricer, when acting as supen/isor, appraises target ert^Dfoyee's performance 
according to an operatfonalized standard and provides direct: aoorooriate fwritten/yert^an 
feedback to the target emptovee on a scheduled or infomial basts. 

1 * Co-worker, when acting as supenrisor, evakiates target empfoyee's performance 
Inconsistentiy (with or without an operatlonaHzed standard, with or without provkling 
approprlafe written/verbitf feedback to the target empfoyee) and only provides feedback if 
performance is perceived to be substandard. 

0 - Co-worker, wiien acting as supen^isor, does nal evaluate and is unaware of taiget 
empfoyeejS performance. 

item 10: information Giving- Co-woriier acts as a source of infomnatfon by spontaneously 
volunteering instnjctfori/feedback (regarding vocatfonal skills, soda! skitis, etc.) and in 
answerkig target employee's questfohs. 

2 * Co-woricer spontaneously volunteers instruction/feedback and answers questons for the 
target empfoyee. 

1 * Co-worker provkies informatfon to the target empfoyca only when directly asked a 
questk>n. 

0 * Co-wori(er discourages target empfoyee's informatfon seeking behavior by not providing 
Infonnatton or answering questfons. 
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Rater Charactertettes bv fl^iablirtvStLdvt 



Reliab«ty Study 



Itfer-ratar Tast^retest 



N«(number of target 68 54 
empioye^s) 

Instrument Rater: 

Employment Specialist 82 B% 

Supervisor 18 11 

Rater's Famliarity with Work SRe: 

3-5 Months 39 35 

6-9 Months 16 24 

10-12 Months 5 8 

More than 1 year 40 33 

Rater's Involvement at Work Site: 

Daily 66 59 

2-4 Tinnes per week 16 24 

Onoeaweek 3 4 

3 Tim^ per rmnth 0 0 

T*vvice per month 3 4 

Oncepermonth 6 7 

Less ^an once per month 6 2 



*all figures are percentages unless othenmse Indicated 
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Tables 

Individual and Employment DenriOQraphlcs bv RQHability Study* 



Reliability Study 



Inter-rater Test^retest 



N«(number of target 68 54 
enr)pioyees) 

Sex of target employee 

Male 48 53 

Female 52 47 

l^el of Mental Retardation 
Borderline or no Mental 

Retardation 17 20 

Mild 42 45 

Moderate 25 27 

Severe 16 8 

Profound 0 0 

Target Employee's Time 
On the Job (months): 

Median 9 7 

Mean 14 11 

Range 98 35 

Type of Placement: 

Indvlduai 20 18 

Clustered Enclave 43 41 

Dispersed Enclave 37 35 

Mobile Work Crew 0 6 

Type of Job: 

Light Industrial 31 15 

Laundry 3 4 

Warehouse 7 9 

Maintenance 18 24 

Retal 0 0 

FoodSen^ 34 40 

Clerical 4 4 

Health Care 3 * 4 



*aii figures are percentages unless othen^e Indicated 
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Factor Analysis 1 (rater 1 time 1) 
Factor Analysis 2 (rater 1 time 2) 
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Figure 2. Organization of the reliability studies. 
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